Entropy scaling and simulability by Matrix Product States 
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We investigate the relation between the scaling of block entropies and the efficient simulability 
by Matrix Product States (MPS), and clarify the connection both for von Neumann and Renyi 
entropies, as summarized in Table |T] Most notably, even states obeying a strict area law for the von 
Neumann entropy are not necessarily approximable by MPS. We apply these results to illustrate 
that quantum computers might outperform classical computers in simulating the time evolution of 
quantum systems, even for completely translational invariant systems subject to a time independent 
Hamiltonian. 
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Understanding the behaviour of quantum many-body 
systems is a central problem in physics. Recently, Ma- 
trix Product States (MPS) have received much inter- 
est as a variational ansatz for the simulation of corre- 
lated one-dimensional systems. They have proven par- 
ticularly powerful in approximating the ground states of 
local Hamiltonians, as used in the DMRG method 0,0], 
but have also been applied, e.g., to simulate the time evo- 
lution of slightly entangled quantum systems 0] . Despite 
considerable progress [^, it is still not fully understood 
which property exactly a state has to fulfil to be well 
approximated by MPS. This knowledge is not only of 
practical interest, but could also tell us how to extend 
the MPS ansatz to, e.g., higher dimensional systems. 

It is generally believed that the relevant criterion for 
efficient approximability by MPS is that the states under 
consideration obey an area law, i.e., the von Neumann 
entropy of a block is bounded. Although indeed both 
ground states of local Hamiltonians and MPS obey an 
area law, there are reasons to doubt this immediate con- 
nection: Firstly, the von Neumann entropy is an asymp- 
totic concept, quantifying what happens when dealing 
with a large number of copies of a state. Conversely, it 
has been shown recently that a rigorous connection can 
be established by looking at Renyi entropies instead [1]. 
Unfortunately, the argument used breaks down as the 
von Neumann entropy is approached. Finally, the conti- 
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TABLE I: Relation between scaling of block Renyi entropies 
and approximability by MPS. In the "undetermined" region, 
nothing can be said about approximability just from looking 
at the scaling. 



unity inequality for the von Neumann entropy carries a 
size-dependent constant, and thus states which are close 
to each other need not be close in entropy 

In this work, we explore the connection between en- 
tropy scaling and approximability by MPS. The results 
are summarized in Table [D An at most logarithmic scal- 
ing of Renyi entropies S'q , a < 1 , implies approximability 
by MPS. On the other side, a faster than logarithmic in- 
crease of S'a, a > 1, rules out efficient approximability 
by MPS, as does linear growth of the von Neumann en- 
tropy. For all other cases, the scaling of the block entropy 
does not allow for conclusions about approximability. In 
particular, this holds for the case of constant von Neu- 
mann entropy, which demonstates that the reason why 
MPS describe ground states well is not simply that those 
states obey an area law. 

Finally, we apply our results to illustrate that quan- 
tum computers might outperform classical computers in 
simulating time evolutions. It is long-known that quan- 
tum computers can simulate the behavior of quantum 
systems '\7'\. However, this does not automatically imply 
that they will outperform classical computers, as, e.g., 
ground states of gapped quantum systems appear classi- 
cally efficiently approximable 0, @| • On the other hand, 
it is known that time evolution even of one-dimensional 
systems under a translational invariant Hamiltonian can 
implement quantum computations if either translational 
invariance is broken by the initial, boundary, or final con- 
ditions, or the Hamiltonian is time dependent and is 
thus hard to simulate. We extend these results by show- 
ing that even the simplest case, the evolution of a transla- 
tional invariant spin i system with translational invari- 
ant initial conditions under a time independent Hamil- 
tonian, cannot be simulated efficiently using MPS; this 
provides evidence that quantum computers might out- 
perform classical computers in simulating these systems. 

Let us first introduce the relevant quantities and no- 
tations. We want to obtain approximations which re- 
produce accurately not only the local properties such as 
energy, but also the non-local ones such as correlations. 
This is ensured by bounding the error made between two 
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states |'0) and \(j)) for an arbitrary observable O, 

\tY[^0]-iv[cl>0]\ < ||0||op||V^-'/'l|tr , 

where throughout the paper, ip = etc. denotes 

the corresponding density operator. We focus on non- 
extensive observables (see Footnote {ivl] for extensive ob- 
servables), therefore w.l.o.g. |10||op < 1- It follows that 
by imposing 



U-^\\tr<S 



(1) 



we bound the error made in any observable by S. 

For some of the proofs it will be more convenient to 
consider the two- norm distance — \4>)\\2 or the fi- 
delity |(0|V')|/|||0)||2||I'0)||2 =■ cos(6'). Fortunately, these 
measures turn all out to be equivalent: Since the best ap- 
proximating MPS will generally not be normalized, it is 
appropriate to consider the optimized quantities, and one 
finds that T{(j),iP) inf„ HV' - a(/)|ltr/||V'l|tr = sin(26l) 
and 1/(0, V) inf„ || |^) - a|(/.) H^/H IV') II2 = sin{9) for 
< 6* < f . 

We now introduce Matrix Product States (MPS) 0, 
lol . 11 1 . Consider a chain of N d-level systems with the 
corresponding Hilbert space 

Hn ■■= (C*)®^ . 

We call \(j}D) e Hjv a Matrix Product State (MPS) with 
bond dimension D (or, briefly, a I?-MPS) if it can be 
written as 
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ii,...,ijv = l 



with Afl D X D matrices for 2 < fc < iV - 1, and 
and row and column vectors of length D, respec- 
tively 18]. 

Given a family {\iPn)) = (|V-'A'))AfeA^cN of states, 
\iPn) G "Hn, we say that it can be approximated effi- 
ciently by MPS if for every i5 > 0, there exists a sequence 
\(I3n,d) of MPS with D = DiN) = 0(j>olysiN)) such 
that \\ipN — 4>N,D\\tr < On the contrary, if there is 
some 6 > such that no sequence of MPS with poly- 
nomial bond dimension can approximate jf/') up to S, 
we say that {\^n)) cannot be approximated efficiently by 
MPS. For brevity, we will sometimes drop the word "ef- 
ficiently" . 

We will measure entropies using the Renyi entropies 
logtrp" 

^a{P) = — , < a < 00 , 

1 — a 

which are a generalization of the von Neumann entropy 
S{p) = — tr[plogp]. In particular, lima^i Sa{p) = S{p). 
Note that all logs are to the basis 2. 

We aim to relate approximability by MPS to the scal- 
ing of block entropies. To this end, we first show that 
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the error made in approximating some state by a D- 
MPS is determined by the error made when truncating 
the Schmidt spectrum of its bipartitions after D values. 
Therefore, let 1-0) G Hn, Pk = trk+i,...,N\i^){'4'\, and let 



X^i^ > Aj"' > • • • > X^^^ be the ordered spectrum of pk- 
Then, define the truncation error 
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Let us now relate the truncation error to approxima- 
bility by MPS. The intuition is that the best an MPS 
with bond dimension D (i.e., Schmidt rank D in any bi- 
partition) can do is to preserve the D largest eigenvalues, 
resulting in an error of ek{D) for the cut at k (which can, 
but need not, accumulate). On the one side, it has been 
shown in Q that for a state G "Hn, there always exists 
an MPS \4>d) with bond dimension D such that 
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N-l 
k=l 

On the other hand, any Z5-MPS satisfies 

\\^ ~ Mtr > ekiD) Vfc, 
since with pk = tri,..._fci/' and (7D,k = tri,...^A;0z), 

\\i> - 0D|ltr > llPfe - 0-_D,fe||tr > efe(-D) . 



Here, we have used: i) the contractivity of the par- 
tial trace, ii) for fixed spectra, the trace norm dis- 
tance is extremal for commuting operators [l^ . and Hi) 
rank (To. fc < D. 

We start the discussion of Table [J by proving the cases 
for which conclusive statements can be made. In the 
following, pj^ will denote any L-particle reduced block of 
a state IV'w) G "Hn- The case of at most logarithmically 
growing Renyi entropy with a < 1 was discussed in [5|, 
where is was shown that it implies approximability. More 
formally, if for a family of states {\tpN)) there exist c, c' > 
and < a < 1 such that Saip^) < clog(iV) + c' 
for all reduced blocks p^, then it can be approximated 
efficiently by MPS. 

Let us now show that a linearly growing von Neu- 
mann entropy implies inapproximability. Formally, if 
for a family (|i/)Ar)), S{pj^) > cL holds for some c > 0, 
L = L{N) > rjN, r] > 0, and some reduced blocks p^, 
then it cannot be approximated efficiently by MPS. 

To prove this, we use Fannes' inequality in its im- 
proved version by Audenaert 0]: For density operators 
p, (T on a if-dimensional Hilbert space, \S{p) — S{a-)\ < 
Tlog{K-l) + H{T, 1-T), where 2T = ||p-f7||tr < S, and 
H{T, 1 - T) < 1 is the binary entropy. Let (|(/>jv,d)) be 
a sequence of MPS approximating (|-0Ar)), and p^, aj^ j-, 
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the corresponding reduces states for which S{pj^) > cL. 
Then, 

\Sip%)~Siaj^^j,)\<^SL\ogd+l , 

and thus, for L > rjN, 

log D{N) > Sia^^o) > Sipj:,) - i^i log d - 1 (5) 
> r]{c- ^Slogd)N -I , 

i.e., the bond dimension grows exponentially in N as soon 
as the error S < 2c/ log d, which completes the proof. 

In the following, we show that a faster than logarithmic 
increase of any Renyi entropy with a > 1 also implies 
inapproximability, i.e., if for a family (|V'Af))) there exist 
a > 1 and k > s.th. Sa{pj^) > cL'^ for some c > 0, 
L = L{N) > r]N, and some reduced blocks p^, then it 
cannot be approximated efficiently by MPS. 

This is proven by lower bounding the truncation error 
e = e{D) of a block pj^ for given Sa{p) {a > 1) and then 
applying This, however, is the same as maximizing 
the entropy while keeping e fixed. Since both the entropy 
and e only depend on the spectrum, the problem reduces 
to a classical one. It is easy to see that the probability 
distribution 



Pi, ■ 



■ ,PD = 



1 - e 

IT' 



PD+l, ■ 



,P2^ = 



2^ -D 



is majorized by all ordered probability distributions (g^) 
which satisfy qo+i + • • • + 92" = ^-i ^-^.d since Renyi en- 
tropies are Schur concave functions, it has maximal en- 
tropy [T^ . Therefore, we obtain the inequality 



So^iPN) < 
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a- 1 



log 



(1-6)" 
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log 
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= log - 



a 



log(l-e) 



Since from ([4]) the total error is (5 > e, we find 



logi^> 5„(p^^) 



a-1 



log(l - S) 



and from Sa{p%) > cL'^ > cij'^N'^, we infer that D has 
to grow exponentially for any S. 

We now turn towards the undetermined region in Ta- 
ble m where we provide examples for both approximabil- 
ity and inapproximability. This task is greatly simplified 
by the fact that approximability examples extend to the 
top and left in Table HI while inapproximability extends 
to the right and bottom. This holds as approximability 
for a given scaling implies the same for more moderate 
scalings (and conversely for inapproximability), and since 
Sa{p) decreases monotonically in a. 

The aim of this work is to clarify the relation be- 
tween entropy scaling laws and the approximability by 
MPS: Therefore, our examples are not constructed to be 



ground states. Yet, all of them form uniform families 
of states, i.e., they can be generated by a uniform fam- 
ily of time dependent Hamiltonians. The existence of 
time-independent realizations is plausible, as the central 
ingredient of the examples are properly distributed en- 
tangled pairs. These could be represented by pairs of 
localized excitations which are prepared locally and then 
propagated by a time-independent Hamiltonian. 

All of the examples can be chosen to be translational 
invariant, with the only possible exception of the inap- 
proximability example for constant von Neumann en- 
tropy. The question whether any translational invariant 
state with bounded von Neumann entropy can be ap- 
proximated efficiently by MPS thus remains open. 

The examples can be grouped into two classes; the first 
is based on states of the type 



\^2n) = ^1~Pn\2) 




x)\x) . (6) 



By choosing — 1/N, we obtain an example of a state 
with linearly growing Renyi entropies for all a < 1 which 
can be approximated by MPS, as 



\\^2n) - ^1-pn\2) 



®2N\ 



fPN 



On the other hand, for L < iV, 



aG{o,i}^ 



and therefore 



So.ip'' 



2N) 



1 — a 



log 



> L 



1 — a 



{I^PnT 
logN . 
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Note that the infavourable scaling of :— for a 
can be compensated by e.g. choosing pn — N^^/'^" . 

The next example provides states with algebraically 
(but sublinearly) growing von Neumann entropy which 
can be approximated efficiently by MPS. Therefore, fix 
< K < 1 and e > 0, and set pn = N'"'-^-'''^ in ® . As in 
the previous example, pn ^ Q implies approximability, 
and 

S{p^n) = HipN, 1 - pn) +Pn log[2^] > L/N<'-''^ , 



which imphes S{p^^) > for L> N". 

We now construct a state which obeys a strict area 
law for the von Neumann entropy but yet cannot be ap- 
proximated by MPS. Therefore, set M = 2A^'^ and define 
Ixm) = |i/'2Ar)®^' with \^P2N) from ©, where pat = 1/N. 
Then, S{p\j) is at most twice the maximum entropy of 
a cut through |V'2Af), and thus 

S{p\j) < 2 (HipN, 1-Pn)+ PnN) < 4 . 
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To prove hardness of approximation, observe that for a 
given D, the best £)-MPS approximation to |V'2Af)®^ 
also carries this product structure, \(I)d)^^ From 
the multiphcativity of the fidehty and the relations fol- 
lowing Eq. (P) one infers T((/)®^, -f/.®^) > ^/KJ8 T{(j), ?/') 
for T(0,V')^ < 2/K. Second, from the truncation error 
eN{D) for IV'ziv), T{cj)D,i^2N) > (2^ - (D - 1))pn/2^ 
for any D-MPS Together, this shows that D > 

2^(1 — 8T(<i>£), xm)) + 1 which is exponential in the sys- 
tem size M = 2N^. 

It is unclear how to make this example translational 
invariant. However, for the adjacent cases in Table [H 
those examples exist: For 5 ~ logL, take the preceding 
example and make it translational invariant by adding a 
tagging system |10 . . . 0)®^ and superposing all transla- 
tions. The resulting state is hard to approximate as the 
translational invariance can be broken by local projec- 
tions on the tags, and since the reduced state is the 
translational invariant mixture of the original, tagged re- 
duced states, the entropy is increased by at most logi. 
For the case Sa ~ const., a > 1, the state dU with con- 
stant does the job. 

The last two examples are of a different type: We con- 
sider N spins on an ring and equidistantly distribute v 
maximally entangled pairs between opposite sites (i.e., 
k and k + N/2), while initializing all remaining qubits 
to |0). The first example, obtained for i' — logN, pro- 
vides a state with Soo ^ logi which is approximable. It 
is clearly an MPS with D ^ 2^°sN ^ f^j. 
c > 0, Sooipj^f) > L^log^J > clogL - 1 for L > cN. 
It can be made translational invariant by superposing all 
translates of the state: On the one hand, this increases 
the bond dimension by at most a factor of N |11)] , while 
on the other hand, the largest eigenvalue of a block of 
length N/\ogN is ^, i.e., the logi lower bound on the 
Soo entropy remains unchanged. 

The second example illustrates that for any k > 0, 
there is a state with 5*0 ^ N'^ which cannot be ap- 
proximated by MPS. Therefore, choose v = TV": Then, 
SoiPN) ^ N'^L/N + 1 < 2L'', while inapproximability 
follows from the superlogarithmic number of maximally 
entangled pairs. Translational invariance is achieved by 
taking the superposition of all translations for k! < k. 
The spectrum of a block of length N/N'^ is broadened 

(l' Tiv"' • ■ ■ ' "ilv")' ^^^^ clearly increases the trunca- 
tion error, and the entropy scaling gets a log correction 
SoifN) < 2i'^'(l + (1 - K')logL) which is bounded by 
for properly chosen k' and L. 

Let us now prove the hardness of simulating time evo- 
lutions with MPS-based approaches, using the results 
obtained (cf. also To this end, take a spin chain 

with all spins up, and apply a critical Ising Hamiltonian 
with periodic boundary conditions. There is good ev- 
idence [l^l that in this case the block entropy of any 
block grows linearly in time, and indeed, a lower bound 



S{pN{t)) > At/Sn + 0{\ogt) for t < eL/4 can be rigor- 
ously proven [l5|. By plugging this into ^ and setting 
L — 4t/e, one finds that for an error 6 < 2e/37r w 0.58, 
the required bond dimension, and thus the effort to sim- 
ulate the time evolution using MPS, grows exponentially 
in time. 

In this work, we have explored the relation between the 
scaling of block entropies and approximability by MPS. 
More refined criteria might be obtained by considering 
more involved figures of merit. For instance, the approx- 
imability proof of \d\ can be adapted to smooth Renyi 
entropies S^{p) — mm{Sa{cr) : \\p ~ cr\\tr < e} [la |. 
Then, the existence of a < 1, e > 0, and c > s.th. 

Sa^^ {Pm) — clogN implies approximability [13]. In- 
deed, the state dU with pn = l/N^ has linearly growing 
Renyi entropies, while the smooth Renyi entropies are 
constant and thus imply approximability. 
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